Papers by Oier Lopez de Lacalle
Detection of Reading Absorption in User-Generated Book Reviews: Resources Creation and Evaluation (2020.lrec-1)
Copied to clipboard
Piroska Lendvai, Sándor Darányi, Christian Geng, Moniek Kuijpers, Oier Lopez de Lacalle, Jean-Christophe Mensonides, Simone Rebora, Uwe Reichel
| Challenge: | a new study aims to detect how and when readers are experiencing engagement with a literary work . empirical literary studies and language technology are used to investigate reading absorption . |
| Approach: | They annotated user-generated book reviews with reading absorption categories . they then performed supervised binary classification of the mental state of absorption . |
| Outcome: | The proposed corpus of user-generated reviews is compared with machine learning models and a benchmark corpus. |
ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizations (2022.naacl-demo)
Copied to clipboard
| Challenge: | Information Extraction (IE) analysts use supervised machine learning to define the schema and build a training corpus with annotated examples. |
| Approach: | They propose a workflow where the analyst verbalizes the entities/relations, which are then used by a Textual Entailment model to perform zero-shot IE. |
| Outcome: | The proposed workflow performs very well on four IE tasks with a single user interface and a video demonstration is available on vimeo. |
Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work shows that Relation Extraction tasks can be recasted as Textual Entailment tasks using verbalizations. |
| Approach: | They propose to recasted RE tasks as Textual Entailment tasks using verbalizations . they show that entailment reduces the need for manual annotation to 50% and 20% . |
| Outcome: | The proposed method reduces the need for manual annotation to 50% and 20% in event argument extraction tasks while achieving the same performance as with full training. |
Label Verbalization and Entailment for Effective Zero and Few-Shot Relation Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Relation extraction systems require large amounts of labeled examples which are costly to annotate. |
| Approach: | They propose to use hand-made relation extraction tasks to refine a pretrained textual entailment engine which is run as-is or further fine-tuned on labeled examples. |
| Outcome: | The proposed system achieves 63% F1 zero-shot, 69% with 16 examples per relation and 4 points short of the state-of-the-art system on the same conditions. |
Linguistic Appropriateness and Pedagogic Usefulness of Reading Comprehension Questions (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing evaluation measures for automatic generation of reading comprehension questions focus on linguistic quality only, ignoring educational value and appropriateness of questions. |
| Approach: | They propose a new evaluation scheme where questions are structured in a hierarchical way . they also create and evaluate two new evaluation data sets for Basque and German . |
| Outcome: | The proposed evaluation scheme can be applied, but expert annotators are needed. |
Event Extraction in Basque: Typologically Motivated Cross-Lingual Transfer-Learning Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Using a multilingual language model, Event Extraction tasks require humans to follow complicated guidelines and follow complicated rules. |
| Approach: | They propose a multilingual multilingual language model that is trained in a source language and applied to a target language. |
| Outcome: | The proposed model is based on a multilingual event extraction dataset for Basque . it shows that the shared linguistic characteristic between source and target languages does have an impact on transfer quality. |
Domain Adapted Distant Supervision for Pedagogically Motivated Relation Extraction (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing systems for question generation based on shallow linguistic information at text level generate questions for reading comprehension. |
| Approach: | They propose a relation extraction system that extracts pedagogically motivated relation types from a text to generate questions for reading comprehension. |
| Outcome: | The proposed system extracts pedagogically motivated relations from a text . it performs better on the subset of relations suitable for pedagical purposes. |